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Abstract 

The proximal average of two convex functions has proven to be a useful tool in convex analysis. 
In this note, we express Goebel's self-dual smoothing operator in terms of the proximal average, 
which allows us to give a simple proof of self duality. We also provide a novel self-dual smoothing 
operator. Both operators are illustrated by smoothing the norm. 

2010 Mathematics Subject Classification: Primary 26B25; Secondary 26B05, 65D10, 90C25. 

Keywords: approximation, convex function, Fenchel conjugate, Goebel's smoothing operator, 
Moreau envelope, proximal average. 



1 Introduction 



Let X be the standard Euclidean space R n , with inner product (■, •) and induced norm || • ||. It will 
be convenient to set 

q = ^IH| 2 . (1) 

Now let /: X — > ]— oo,+oo] be convex, lower semicontinuous, and proper. Since many convex 
functions are nonsmooth, it is natural to ask: How can one approximate / with a smooth function? 
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The most famous and very useful answer to this question is provided by the Moreau envelope 
[HQS], which, for A > 0, is defined by0 



e A / = /DA- 1 q. 



(2) 



It is well known that e\ f is smooth and that lim A _ i> Q+ e\ f = f point- wise; see, e.g., [151 Theo- 
rem 1.25 and Theorem 2.26]. 



Let us consider the norm, which is nonsmooth at the origin. 

Example 1.1 (Moreau envelope of the norm) Let A G ]0, 1[, set / 

closed unit ball by C. Then, for x and x* in X, we haved 



e\f(x) 



x 



2A 



if llxll < A; 



2> if IMI > A ' 



and denote the 



(3) 



{exf)* = ic + M: ande A (/*)(x*) = (2A)" 1 • ( max{0, \\x* \\ - l}f . Consequently, (e A /)* + e x (/* 



Proof. Either a straight-forward computation or [15} Example 11.26(a)] yields 

r = i C . 



Next, if y € X, then 



ei/A ><c{y) = inf Aq(y - c) 



^2 



(4) 

(5) 
(6) 



and thus 



ei/A i^c{x/X) 



A 

— • < 

2 



A 
2 



1) ; 



0, 



if IMI > i; 
if IMI < i, 



(||x/A|| - l) 2 , if ||o:|| > A; 
0, if llzll < A. 



(7) 



(8) 



lr The symbol "□" denotes infimal convolution: (/i D/b) (a;) = inf M (fi(y) + fz{x — y)). 

2 Here Lc(x) = 0, if x € C; Lc(x) = +oo, if x $5 C is the indicator function, f*(x*) = sup xex ((x,x*) — f(x)) 
the Fenchel conjugate of /, and dc — \\ ■ | D lc is the distance function. 
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By [151 Example 11.26(b) on page 495], we obtain 

1 

A 



e x f(x) = \q(x)-e 1/x f(x/\) (9) 



(10) 




(11) 



and (e\ /)* = /* + Aq = lq + Aq. Alternatively, one may use [5J Example 2.16], which provides the 
proximal mapping of /, and then use the proximal mapping calculus to obtain these results. ■ 

While the Moreau envelope has many desirable properties, we see from Example 11.11 that the 
smooth approximation e\ f is not self-dual in the sense that 

{exfY^exin (12) 

It is perhaps surprising that self-dual smoothing operators even exist. The first example appears 
in [9]. Specifically, Goebel defined 

G A / = (l-A 2 )e A / + Aq (13) 

and proved that 

{G x f)* = G x (t), (14) 

i.e., Fenchel conjugation and Goebel smoothing commute! For applications of his smoothing oper- 
ator, see [9]. 

The purpose of this note is two-fold. First, we present a different representation of the Goebel 
smoothing operator which allows us to prove self-duality using the Fenchel conjugation formula for 
the proximal average. Secondly, the proximal average is also utilized to obtain a novel smoothing 
operator. Both smoothing operators are computed explicitly for the norm. The formulas derived 
show that the new smoothing operator is distinct from the one provided by Goebel. 

For f\ and / 2 , two functions from X to ]— oo,+oo] that are convex, lower semicontinuous and 
proper, and for two strictly positive convex coefficients (Ai + A2 = 1), the proximal average is 
defined by 

pav(/ 1 ,/ 2 ;A 1 ,A 2 ) = (A 1 (/ 1 + q)* + A 2 (/ 2 + q)*)*-q. (15) 

See [U El El HI El El [TO] for further information and applications of the proximal average. The key 
property is the Fenchel conjugation formula 

pav f 2 ; Ai, A 2 )* = pav (/*, / 2 ; Ai, A 2 ) ; (16) 
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see [H Theorem 6.1], [2j Theorem 4.3], or [TJ Theorem 5.1]. 

We use standard convex analysis calculus and notation as, e.g., in [14 |, I15| . [18] . In Section [21 we 
consider Goebel's smoothing operator from the proximal-average view point. The new smoothing 
operator is presented in Section [3] 



2 The Goebel smoothing operator 

Definition 2.1 (Goebel smoothing operator) Let f: X — > ]— oo,+oo] be convex, lower semi- 
continuous and proper, and let A G ]0, 1[. Then the Goebel smoothing operator [9] is defined 
by 

G x f = (l-X 2 )e x f + \q. (17) 

Note that (|17p and standard properties of the Moreau envelope imply that point-wise 

UmG A / = / (18) 

A->0+ 

and that each G\ f is smooth. 

Our first main result provides two alternative descriptions of the Goebel smoothing operator. 



The first description, item (i) in Theorem \2.2\ shows a pleasing reformulation in terms of the 



proximal average. The second description, item (ii) in Theorem 12.21 is less appealing but has the 



advantage of providing a simple proof of the self-duality (iii) observed by Goebel. 



Theorem 2.2 Let f : X — > ]— oo,+oo] be convex, lower semicontinuous and proper, and let A € 
]0, 1[. Then the following hold^. 

(i) G x f = (1 + A)pav(/,0;1-A,A) + Aq. 

(ii) G\ / = (1 + A) 2 pav (/, q ; ^) o (1 + A) -i Id . 

(iii) (Goebel) (G x f)* = G x (f*). 



3 Here Id : X — > X : x t-¥ x is the identity operator. 
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Proof. Let Then, using JT5J) and standard convex calculus, we obtain 



(1 + A) 2 pav (f, q ; L^, o (1 + A) -1 Id Vx) 



1 - A 



2A 



( 1 + A ) 2 (m^ + ^ + m^(rfA)-^) 

(l + A)((l-A)(/ + q)* + Aq)*(x)-q(x) 
(1 + A) ( ((1 - A) (/ + q) * + A(0 + q) *) * - q) (x) + Aq(x) 
(l + A)pav(/,0;l-A,A) + AqVx). 



(19) 

(20) 

(21) 
(22) 
(23) 
(24) 



We have verified that (|22p as well as the right sides of (i) and (ii) coincide. Starting from (j22[) and 
again applying standard convex caluclus, we see that 



(l + A)((l-A)(/ + q)* + Aq) (x) - q( 



(1 + A) ( ((1 - A) (/ + q) *) * □ (Aq) *) (x) - q(x) 



(1 + A) (Jl - A) (/ + q) (—J □ -qj (x) - q(x) 

(1 + A) inf ((1 - A) (/ + q) (^) + iq(x - y)j - q(x) 

(1 + A) inf ((1 - A ) /( r ^) + (1 - A)q( r ^) + Iq(x - y) - ^(x)) 



1 



(1 - A 2 ) inf /( -JL-) + q( -JL- ) + T7T ^q(x - y) 



y\ J \l-XJ V 1 - A / A(l-A) 
Simple algebra shows that for every y € X, 



1-A 2 



q(z 



i i 1 t-^-t) + 777— - v) 



1-XJ A(l-A) 



i , x i ( y \ a . . 

—^ x) = \< X -—\) + — A^ q(x) 



(25) 
(26) 

(27) 
(28) 
(29) 
(30) 

(31) 
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Therefore, 



(l + A)((l-A)(/ + q)* + Aq)*(*)-q(x) 



A(l-A) 



q(x - y) 



1 - A 2 



q(x) 



(1-A 2 )inf / 



V \ , 1 



+ — q(+ 



» VVl-A/ A"V 1-A/ 1-A 2 



( 1 - A 2 ) inf ( f(z) + jq(x - z) + j^a^ 



((l-A 2 )e A / + Aq)( 3 
G A /(x), 



(32) 
(33) 

(34) 

(35) 

(36) 
(37) 



which completes the proof of (i) and (ii) 



hi 



obtain 



1-A 2A 



In view of the conjugate formula ((3 2 h o (/3 1 Id))* = j3 2 h* o (/3 1 Id), (ii) and ([IB]) , we 

(38) 
(39) 



(G A /)* = f (l + A) 2 pavf/,q;— J o(l + A)- 1 Id 



(1 + A) 2 pav /,q; 



+ A 
1-A 2A 



1 + A' 1 + A 



(l + AfpavfAq*; 1 A 2A 



1 + A' 1 + A 



(1 + A)" 1 Id 



o (1 + A)" 1 Id 



(l + Af pa v(/*,q;— •— I o 



1 + A' 1 + A 



(1 + A)" 1 Id 



G x (/*)■ 



(40) 

(41) 
(42) 



The proof is complete. 



Remark 2.3 Theorem [23 \i) li (ii) gives two representations of the Goebel smoothing operator in 
terms of the proximal average. Goebel [8] discovered a converse formula, which we state next 
without proof: 

pav (/, q ; A, 1 - A) = ^^1! Ga/(2 _ a) / o Id ) . (43) 
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Example 2.4 Let A G ]0, 1[ and set / = || • ||. Then, for every x € X, 

l~l|2 



2A ' 
Allxll 2 



if ||x|| < A; 



+ (1 - A 2 )|[x|| - — ^ \ if INI > A. 



(44) 



Proo/. Combine (HID and ©. 



3 A new smoothing operator 

We now provide a novel smoothing operator that has a very simple expression in terms of the 
proximal average. 

Definition 3.1 (new smoothing operator) Let f:X—> ]— oo,+oo] be convex, lower semicon- 
tinuous and proper, and let A € ]0, 1[. Then the S\ f is defined by 



S x f = pav (/, q ; 1 - A, A) 



(45) 



Theorem 3.2 Let f : X — > ]— oo,+oo] be convex, lower semicontinuous and proper, and let A € 
]0, 1[. Set fi = A/(2 — A). Then the following hold. 



(i) 5 A / = (l-A)e M /o( 5 ^Id)+ M q. 



(ii) (Sa/)* = S A (/*). 



Proof. Let Then, using (135]) . (fl~5]) and standard convex calculus, we obtain 

(S X f)(x) = ((1 - A)(/ + q)* + A(q + q)*)*(x) - q(s) 

= ((l-A)(/ + qr + |q)*(x)-q(x) 

(l-A)(/ + q)(— )n|q] (s)-q(z) 



inf ^(1 - + (1 " A )i(i3a) + X q( ' " /;) " ll( ' r) 



: 1 - A > [ f ( A) + q ( A) + a(T^a) " y) " r 1 ! «*> 



(46) 
(47) 

(48) 
(49) 
(50) 
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Simple algebra shows that for every y € X, 

t V \ 2 / x 1 . . 2 — A / 2a; y \ A , . ,„.,. 



A(l-Ap ' A ^V2-A 1-A/ (1-A)(2-A) 

Therefore, 

& M*) = (1 " ^ (/(^) +^<5?X-T^) + (1 -A)(2-A) ^) (52) 
= (1 - A) inf (f(z) + - z)) + ^qfcr) (53) 



A ^V2-A J 2-A 



as claimed. 



(l-A)(/niq)(^ x )+/,q(x), (54) 



(ii) Using ([4"5]) and (fT6j) . we get 



(S A /) * = ( pav (/, q ; 1 - A, A) ) * = pav (/*, q* ; 1 - A, A) = pav (/* , q ; 1 - A, A) = S x (/*). (55) 
The proof is complete. ■ 

Note that Theorem 13. 2](i)| and standard properties of the Moreau envelope imply that point- wise 

lim S x f = f (56) 

and that each S\ f is smooth. 

Example 3.3 Let A G ]0, 1[ and set / = |[ • ||. Then, for every x € X , 



2A ii ii - 2 ' 

A||x|| 2 2(1 — A) A(l-A) A 



(57) 



[2(2- A) + 2-A " X " 2(2 -A)' lf > 2' 



Proof. Combine © and Theorem I3.2TI 



Remark 3.4 Let / = || • ||. The explicit formulas provided in Example 12.41 and Example 13.31 imply 
that G a f Sp f, for all a and (3 in ]0, 1[. Thus, the smoothing operator defined by (j33J) is indeed 
new and different from Goebel's smoothing operator. 

Remark 3.5 Given a more complicated function /, the explicit computation of the smoothing 
operators Ga / and S\ f may not be so easy. However, computational convex analysis provides 
tools [T2] to compute the Moreau envelope numerically which — due to the Moreau envelope 
formulations (117p and Theorem I3.2j(i)| — makes it possible to compute the smoothing operators 
G\ f and S\ f numerically. 

Finally, other approaches to smooth approximation are: Ghomi's integral convolution method 
[7], Seeger's ball rolling technique [16], and Teboulle's entropic proximal mappings [T7] . 
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